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PATENT 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re application of: 

HAEBERLI 

Application No.; 09/684,595 

Filed: November 5, 2000 

For: Previewing a Framed Image 
Print 



Examiner: Yang, Ryan R. 
Art Unit: 2672 



RENEWED PETITION 
UNDER 37 CFRJ .137(b) 



In response to Decision on Petition 
mailed 1 1/29/2006 



Box DAC 

Assistant Commissioner for Patents 
Washington, D.C. 20231 

Sir: 



Applicant respectfully addresses the two requirements in the Decision on Petition 
mailed on 1 1/29/2006 as following: 



(!) A response to the non-final action of July 28, 2O05 is attached; a?id 



(3) Applicant makes the following formal statement: 

"The entire delay in filing the required repl> from the due- date for the rep ly 
until the filing of a grant able petition pursua nt to 37 CFR L 137(b) was unintenti onal." 



Respectfully submitted. 



Xin Wen 

Reg, No. 53,758 
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patent 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re application of: 



Examiner; 



Yang. Ryan K. 



HAEBERLI 



Art Unit: 



2672 



Application No.: 09/684,595 



Filed: November 3, 2000 



For: Previewing a Framed image 
Print 



RESPONSE TO OFFICE ACTION 



Mailed 7/28/2005 



Commissioner for Patents 
PO Box 1450 
Alexandria, VA 22313 

Sirs: 

The Office Action mailed Ju!\ 28. 2005 rejected claims 1-9, 1 1-1 5, 1 7-19 and 21 
under 35 U.S.C. 303(a) as being unpatentable out Oks (6,047.13(0. Katn (S^.Tlh) and 
further in stew Dawson et ai. f5.17y.638 >. Claim 10 was rejected under 35 C.S.C. J 03(a) 
being unpatentable over Oles (6.047,130) in view of Dawson, Kato and Kurashigc 
(5.282,262), Claim \t> uas rejected under 35 L.S.C. I 03* a) as being unpatentable over Obcrg 
< 5.8^0,771) in siew ol Oles, Kato and Davsson. 

applicants respectful!) submit amended claims and arguments Applicants belies e 
that a)! the issues in the ollke action have been addressed and all claims are in condition for 
allowance. 
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PENDING CLAIMS 

\. t< urrentJy Amended) A method of generating a frame prototvpe image shoeing a picture 
image framed within a frame, the method comprising: 

providing a frame image showing the frame in a perspective mow, (he frame image 
having a picture portion corresponding to the portion of the frame used to view a picture 
mounted in the .frame; 

texture mapping the picture image to the picture portion of the frame image in order 
to generate the frame prototype image; and 

multiply ing m^iVm-g-a texture \aiue at a pi\ci by the original pixel value of the 
picture image to generate the frame prototype image. 

2. (Original) The method of claim 1 . further comprising identifying a picture portion of the 
frame image. 

3. (Original) The method of claim 2, wherein identifying the picture portion of the frame 
image includes providing a mat identifying the picture portion of the frame image. 

4. (Original) The method of claim 3, wherein the mat includes a plurality of pixels, each 
pixel having a pixel value. 

5. (Original) The method of claim 4, wherein identifying the picture portion of the frame 
image incl udes setting each pixel in the mat that corresponds to the picture portion of the 
frame image to a first pixel value. 

6. {Original) The method of claim 2, wherein identif\ ing the picture portion of the frame 
image includes identifying the outer perimeter of the picture portion of the frame image 

7. (Original) The method of claim 1, wherein the picture portion of the frame image has a 
quadrilateral shape and the method further includes identifying the picture portion of the 
frame image including identifying the tour comers of the picture portion. 



8. (Original) The method of claim 3 , further comprising displaying the frame prototype 
image. 
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9. {Previously Amended) The method of claim .1, mapping the picture image to the picture 
port ion of the frame image includes texture mapping the picture image to the picture portion 
of the frame image. 

10. (Original) The method of claim I, wherein the mapping the picture image to the picture 
porti on of the frame image includes mappi ng the picture image to the picture portion of the 
frame image using the illumination of the picture portion of the frame image. 

1 1. (Original) The method of claim 1, wherein the frame image is captured using a digital 
camera. 

12. (Currently A mended ) A computer program product tangibh embodied in a computer- 
readable medium, for generating a irame prototype image showing a picture image framed 
within a frame, comprising instructions operable to cause a computer to: 

receive the picture image; 

More a frame image showing the frame in a perspeethc \ie\v and a mat identifying 
the picture portion of the frame image; 

texture map the picture image to the picture portion of the frame image in order to 
generate the frame protoHpc image: and 

muj.tir>iv mod i fy a lecture \alue at a pixel by the original pixel vaiuc of the picture 
image to generate the frame protot} pe image. 

13. (Original} The computer program product of claim 12 further comprising instructions 
operable to cause the computer to generate the map. 

14. (Original) The computer program product of claim 13 further comprising instructions 
operable to cause the computer to generate the map by identifying the picture portion of the 
irame image. 

15. i Original } The computer program product of claim 12 further comprising instructions 
operable to cause the computer to identify the picture portion of the frame image b> 
identifj ing the outer perimeter of the picture portion of the frame image. 
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16. (Currently Amended) A system Tor generating a frame prototype image showing a picture 
image framed within a frame, the system comprising: 

a client computer in communication with a computer network; 

a server, in communication with a computer network, having server software 
embodied in a computer-readable medium, the server software comprising instructions 
operable to cause the server io: 

receive the picture image from the client computer; 

store a frame image showing the frame in a perspective view and a mat identifying 
the picture portion of the frame image; a«4 

texture map the picture image to the picture portion of the frame image in order to 
generate the frame prototype image; and 

multiply a texture value at a pix el by the o riginal p ixel valu e of the picture image to 
generate the frame prototype image, 

wherein the client computer includes client software embodied in a computer-readable 
medium, the client software comprising instructions operable to cause the client computer to 
upload the picture image to the server. 

17. (Currently Amended) A method of generating a visual representation of an image based 
product, the method comprising: 

providing an image to be included in the image based product; 

providing a perspective image showing the image based product in a perspective 
view, the perspective image having a picture portion corresponding to the portion of the 
image based product used to view a picture mounted on the image based product; and 

texture mapping the image to the picture portion of the perspective image in order to 
generate the perspective prototype image; and 

mult iplying m-od-iiyi-n-g-a texture value at a pixel by the original pixel value of the 
picture image to generate the frame prototype image. 

18. (Original) The method of claim 17 wherein the image based product is a framed picture. 



1°. (Original) The method of claim 1 7 wherein the image based product is a photocard. 
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20. (Original) The method of claim 17 wherein the image based product is a photo greeting 
card. 



21. (Original) The method of claim 20 wherein the method includes displaying the 
perspective image in an environment that provides a context for viewing the image based 
product. 
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The Section 103 Rejections 

Claim 1 recites the following invention: 

A method of generating a frame prototype image showing a picture image framed 
within a frame, the method comprising: 

providing a frame image showing the frame in a perspective view, the frame 
image having a picture portion corresponding to the portion of the frame used to view 
a picture mounted in the frame: 

k-xture mapping the pieture image to the picture portion of the frame image in 
order to generate the frame prototype image: and 

texture vaiue at a pixel b> the original pixel value of the picture 
image to generate the frame prototype image. 



The Office Action noted that; 



As per claim I , Otes discloses a method of generating a frame 
prototype image showing a picture image framed within a frame, the method 
comprising: 

providing a frame image showing the frame in a perspective view, the 
frame image having a picture portion corresponding to the portion of the 
frame used to view a picture mounted in the frame (Figure 4 26); and 

mapping the picture image to the picture portion, of the frame image in 
order to generate the frame prototype image (figure 3 24 to Figure 4 24). 

Dies discloses a method of generating a frame prototype image. It is 
noted that Oies does not explicitly disclose "modifying a texture value at a 
pixel by the original pixel value of the picture image to generate the frame 
prototype image", however, this is known in the art as taught by Kato et ah 
hereinafter Kato. Kato discloses the frame prototype image is generated from 
the original picture (the design simulation is carried out by photographing or 
taking the picture of the interior of the automobile and then modifying the 
texture of a seat part in the photographed picture image, column 2, line 43- 
46). 

Thus, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to incorporate the teaching of Kato into OSes 
because Dies discloses a method of generating a frame prototype image and 
Kato discloses a frame prototype image can be modified in order to assist 
design simulation. 

Oies and Kato disclose a method of generating a frame prototype 
image, it is noted that Oles and Kato do not explicitly disclose using texture 
mapping the picture image of the frame image to generate the frame prototy pe 
image, however, this is known in the art as taught by Dawson et al.. 
hereinafter Dawson. Dawson discloses a method of providing a texture 
mapped perspective view for digital map systems (column 2, line 61-62, since 
the digital map is a prototype image). 
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Thus, it would have been obvious to one of ordinary skill in the art at 
the lime the invention was made to incorporate the teaching off Jaw son into 
Oies and Kato because Oies and Kato disclo.se a method ot generating a 
prototype image and Dawson discloses the image texture can be texture 
mapped in perspective in order to enhance visual reaiit) {column 1, Sine SO). 

"Hie instant application discloses "multiplying the texture value by the original value 
of the pixel. . {Page 7, Lines 3-5} and also "multiph texture valise by pixel vafue from 
picture area'" (Figure 4, Step 406}. I he instant application displa>s the original image content 
in the display image frame. In other words, the image content in the original image is 
preserved in the final frame image. 

Kato relates to a "texture mapping method that projects a specified texture picture 
onto the surface of an object in another specified picture. Three-dimensional data on the 
surface shape of the object to he projected is not known previously. The three-dimensional 
data on the surface shape of the object is estimated on the basis of the data in the objective 
picture to attain the texture mapping." < Abstract}. Col. 2, lines 43-46 of Kato notes that "the 
design simulation is curried out by photographing or taking the picture of the interior of the 
automobile and then modifying the texture of a seat part in the photographed picture image.'" 

Kato depicts "modifying a texture value at a pixel on the original pixel value of the 
pkture image to generate the frame prototype image" (Column 2, lines 43-46} a> toflows: 

In fig. 6A, an original 3D picture is shown to include a flower pattern on a car scat. 

In Fig. 6B. a texture {a grid pattern) is selected. The texture is characterized bs a 
shape mode! (sec Fig. 4, step 402), 

In Fig. oC, the original pixel values (i e. the flower pattern) are removed and replaced 
by. the textu re value (i.e. the grid pattern). The original pixel values (Le. the flower pattern) 
are lost after the texture values arc applied to the car seat. If the texture pattern is found not 
appealing, the "shape model" lor the texture value will lie "modified'" (Fig. 4, steps 402-406). 

In view of the above argument, Kato does not teach or teaches the opposite to the 
limitation "muliiphing a texture value at a pixel by the original prxci value of the picture 
image to generate the frame prototype image" in the amended claim 1. Similarly, neither 
Dawson nor Oies discloses this limitation of claim L Dawson also docs not disclose a feme 
prototype Since at least one element is missing. Oies, Kato, Dawson, sing!) or in 
combination, cannot render claim 1 obvious. 
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Further, Oles does not show the claimed perspective view , The Office Action 
asserted that, since OSes' "(ami the site of the resulting) as well as move and position the 
combined image" are additional conditions of perspective view and since the two variables 
(si/'e and position) are the onl> variable allowed to change in a head-on view image. Oles 
implies a perspective image means more than a head-on view and includes angle view. 

Applicants disagree with the "implied" information prov ided using hindsight. 
Column 2 line 1 of Dies states "The present indention overcomes these deficiencies b\ 
providing a method and apparatus that allow s a customer to visual K determine the 
appropriate si/e of a portrait photograph and matching picture frame by displacing upon a 
portrait display viewer a perspective view of a combined \ideo image of the photograph and 
the matching frame within a simulated room image." Further, Column 5 line 31-35: "The 
present invention as depicted in FIG. ? allows the customer or operator to change the 
perspective of the video image (and the size of the resulting portrait) as well as move and 
position the combined image within the simulated room setting image." This is further 
supported by the fact that all Oles figures show, a frontal view of the picftiie. The fact that 
the monitor showing the simulated pictured) is shown in a 3D perspective view further 
supports the contention that the "perspective view" in Oles is not the perspective view as 
claimed, 

Oles, Kato and Dawson fail to show at least the multmh ing a texture value at a pixel 
by the orig inal pixel value of the picture image to generate the frame pro totype image. The 
office action points to Oles' Fig. 4 26 to fig. 5 2t> as showing the modification of the texture 
value at a pixel b> the original pixel value of the picture image to generate the frame 
piotots pe image. However, the description o! Fig. 4 fails to show this aspect, among others. 
As noted in Oles: 

Once satisfied with the combined image and referring now to FIG. 4, the 
customer can select a particular simulated room setting image 28 for dispiav ing the 
combined image. 1 he customer/operator scrolls through a series of simulated room 
setting images such as dens, living rooms, libraries, or bedrooms to find an image 
suitable for displaying the combined image. I ike the picture frame images, the 
present invention includes previous!} stored images ot simulated room settings for 
later retrieval. After selecting the simulated room setting image 28, the present 
invention combines the combined picture frame image 26 and video image 24 with 
the ^elected simulated room setting image as depicted in HG. 4 to produce a 
simulated perspective room image. As previously stated, the present invention 
initial!) transposes the video image as a 5".timcs.7" image; and when combined with 
the room image, the video image appears in a perspective view ol the room image to 
produce a simulated perspective room image. In other words, the combined video and 
picture frame image appears to the customer on video portrait viewer 20 in a 
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perspective view, as 5".times.7" picture would appear in the selected room setting, 
tjpon seeing the perspective view, the customer can immediately determine whether 
the size of the portrait is correct, whether the picture frame matches the portrait, and 
whether the combined portrait and picture frame will match the selected room. The 
present invention as depicted in FIG. 5 allows the customer or operator to change the 
perspective of the video image (and the si/.e of the resulting portrait) as well as move 
and position the combined image within the simulated room setting image. If for 
some reason, the customer does not want a picture (Tame, the present invention will 
work equally as well in displaying a video image of a portrait in a simulated 
perspective room image without a picture frame bordering the video image. 
Additionally, the present invention allows the customer to view one or more video 
images, with or without the pictuie Irarne image combination, in combination with 
the simulated room setting image so that the customer can see a perspective v icw of 
multiple portraits in a simulated ioom. 



The above section in Oles compels the conclusion that < >les does not discuss the 
multiplying a te\rure value at a pixel by the original pixel value of the picture image to 
generate the frame piototy pe image, among others, Kato and Dawson are similarly lacking 

Additionally, the Office Action noted that "Since Oles specifically points out '{and 
the si^e of the resulting) as well as move and position the combined image" are additional 
conditions of perspective view and since the two variables (st/e and position) arc the only 
variable allowed to change in a head-on view image, Oles implies a perspective image means 
more than a head-on view. There fore, a perspective view includes angle view." 

Applicants respectfully ponts out that the "perspective" term in Oles relates to the 

"st/e of the resulting portrait". In contrast, in the present invention, page (j provides 4 

discussion of the "perspective view*\- 

A "perspective frame image" is an image that shows an in-perspective view of a 
frame. In other words, the frame in such a perspective frame image is not shown 
in a head-on view . For example, a frame can be arranged m a typical scene in which 
the frame might be displayed (e g.. on a tabic) and then a digital camera can be used 
to capture a perspective image of the Irarne as it appears in the scene. Also, a white 
piece of paper (or other suitable matcrtal) can be mounted in the frame where an 
image print would he displayed. As a result, the perspective frame image will include 
a white region located where an image print would be visible in the frame {also 
referred to here as the "picture area''). An example of such a perspective frame image 
300 having a picture area >02 is shown in FIU > A. 

As discussed above. Oles only shows a head-on view and does not show the 
perspective view. Kato does not mention perspective. Dawson is a hardware reference and 
there is no suggestion in the software system of Oles to incorporate the texture as hardware. 
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Based on the foregoing. Applicant re$pectfuil> traverses the Section 103(a) rejection. 
Applicant notes that the present rejection does not establish prima lack obviousness under 
^5 U.S.C. § 103 and M P.E.P. §§ 2342-2 143. 1 he Examiner bears the initial burden to 
establish and support pn ma facie obviousness, In rc RweharL 18^ U.S.P.Q. V-P tC CPA 
1976). To establish prima facie obviousness, three basic criteria must be met. M.P.H.P 
2J42. first, the Examiner must show .some suggestion or motivation, either in the cited 
references or in the knowledge general!}' available to one of ordinary skill in the art to 
modify the reference so as to produce the claimed invention. M.P.fc.P. § 214101: (n re Fmc 
5 U.S.P.Q.2d 15% (j ed. Cir. N88). Secondly the 1 xaminer must establish that there is a 
reasonable expectation of success for the modification. M.P.E.P. §2142. 'ihirdiy, the 
Examiner must establish that the prior art reierences teach or suggest all the ciaim 
limitations. M.P.t.P. §2143.03: //; re Royhu 180 It.S.P.Q. 580 (CCPA 1<"41. The 
teachings, suggestions, and reasonable expectations of success must be found in the prior art, 
rather than in Applicant's disclosure. In re VaecL 20 U.S.P.CUd 1438 {('AFC ). 
Applicant rcspectfull> submits that a prima }acie case ol obviousness has not been met 
because the Examiner's rejection fails on all of the above requirements 

in sum, kato. Dawson, and Oles do nut teach at least one limitation in the amended 
claim L Oles, Kato, Dawson, singly or in combination, cannot render claim 1 obvious. 
Eurfhermore. regarding claim 10, the Office Action did not establish that there is a reasonable 
expectation of success for the modification. M.P.H.P. § 2542. Neither Oles, Kato Dawson, 
nor Kurashigc shows at least "the mapping the picture image to the picture portion of the 
frame image includes mapping the picture image to the picture portion of the frame image 
usmg the illumination of the picture portion of the frame image" in claim 10. Withdrawal of 
the Section 103 rejection on claim 1 and its dependent claims 2- 11 is requested. 

Calims 12 and 17 have been rejected similar to claim 1. The amended claim 12 
includes the limitation "muhiph.a texture value at a pixel by the original pixel value of the 
picture image to generate the frame prototype image'". The amended claim 1 7 includes the 
limitation "multiply _a texture \alue at a pixel b\ the original pixel value of the picture image 
to generate the frame prototype image." Smec neither Kato nor Daw, son nor OSes teaches at 
least the above limitation in the amended claims 12 and 1 7, Oles, Kato, Dawson, singh or in 
combination, cannot render claim 12 and 1 7 obwous. Withdrawal of the Section 103 
rejection on claims 12 and 17 and their respective dependent claims 13-15 and 18-21 is 
respectfully requested. 
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Claim 16 was rejected under *5 I J.S.C, {03(a) as being unpatentable over Oberg 
(5,870,771) in view of Otes, Kato and Dawson The amended claim 16 includes the 
limitation "multiplv a texture value at a pixel hv the original pixel value ol the picture image 
to generate the frame prototype image". Neither of the cited references teaches this 
limitation. 'I he Office Action also did not establish that there is a reasonable expectation of 
success for the modification. M P.F.P. § 2 {42. Moreover, the prior art references fail to 
teach or suggest all the claim limitations. Since at least one limitation is missing in Oles, 
Kato. Dawson, and Oberg, Oles, Kato, Dawson, and Oberg smglj or in combination, cannot 
render claim 16 obvious. Withdrawal of the Section 103 rejection on claim 16 is respectfully 
requested. 



Applicants respeetfulh submit that all claims are m condition for allowance. 
Withdrawal of the rejection is icspeetfulh requested, If for any reason the Examiner 
believes that a telephone conference would in any waj evpedhe prosecution of the subject 
application, the Kxaminer is invited to telephone the undersigned. 



CONCLUSION 



Respectful!) submitted, 




Xin Wen 



Reg. 53,758 



